Papers with Language Models(PLMs
AdminSet and AdminBERT: a Dataset and a Pre-trained Language Model to Explore the Unstructured Maze of French Administrative Documents (2025.coling-main)
Copied to clipboard
| Challenge: | Pre-trained language models are used to analyze documents but administrative texts are unstructured and do not perform well. |
| Approach: | They propose a French pre-trained language model for the administrative domain . they compare it with a general domain language model and a large language model . |
| Outcome: | The proposed model improves performance on administrative and general domains. |
Adversarial Knowledge Stimulated Contrastive Prompting for Few-shot Language Learners (2023.findings-acl)
Copied to clipboard
| Challenge: | Prompt-based fine-tuning has boosted performance of Pre-trained language models on few-shot Natural Language Understanding (NLU) tasks by employing task-specific prompts. |
| Approach: | They propose a Cloze-driven prompt framework for prompt tuning that implicitly stimulates knowledge from pre-trained language models. |
| Outcome: | The proposed framework outperforms state-of-the-art for prompt-based fine-tuning on few-shot NLU tasks. |